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Abstract: In this paper we propose i-SERF (integrated-Self Evaluated and Regulated Framework) an integrated self- 
evaluated and regulated framework, which facilitates synchronous and asynchronous education, focusing on teaching and 
learning in higher education. The i-SERF framework is a two-layered framework that takes into account various elements of 
existing frameworks, introducing though as a new element the means of a self-evaluation, self-feeding and regulation 
mechanism. This mechanism is based on the performance of students, on the students' answers to appropriately 
structured questionnaires and on the online monitoring of the supporting platform's parameters. The outcome derived 
from a "self-evaluation" process is then feeding i-SERF in order to obtain self-regulation, for the next deployment. In this 
way, i-SERF remains alive and progressing. The proposed framework aims to offer the needed background for designing 
Web 2.0 educational platforms that may exhibit continuous improvement functions, providing in that way considerable 
benefits to both students and tutors in various fields. A pilot implementation, using an education-oriented suite with 
enriched interactive elements supporting a variety of terminal devices, combined with a thorough assessment that utilizes 
advanced statistical tools has revealed the potentials of the platform to successfully deploy the principles of the i-SERF 
framework to yield powerful learning experiences and high quality interactions between students and teachers. 
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1. Introduction 

Web 2.0 technologies encompass a variety of different meanings, including an increased emphasis on user 
generated content, data and content sharing, collaborative efforts, new ways of interacting with Web-based 
applications, and the use of the Web as a social platform for generating, repositioning and consuming content 
(Harris & Rea, 2009). These technologies have been deployed widely since 2004 (O'Reilly, 2005) as part of the 
social networking revolution. The field of education could not remain unaffected as today's learners demand 
from the educational institutions to continuously assess their pedagogical approaches to the learning and 
teaching process, both in face-to-face and in virtual classrooms (Huertas et al., 2007). 

In the scientific literature, one can find several works which argue that technologies can never be neutral; they 
have specific affordances that might facilitate certain approaches and minimise others (Dron 2006; Feldstein & 
Masson 2006). The technology itself is neither good nor bad; it is the way that it is exploited that matters 
(Bates 2005; Nichols 2005). According to Bates (2005), a useful approach is to identify the kinds of learning 
that different media facilitate best, and under what conditions. The issue, then, is whether we are using 
technology to do the same things, or we take advantage of the unique capabilities of the technology to do 
things differently (Oblinger & Hawkins 2006). The successful incorporation of a new technological element or 
infrastructure in education pre-supposes its effective integration with pedagogical knowledge and context 
(subject matter) specialties. Education though is a dynamic and open system with "material" transfers into or 
out of the system boundary, which remains progressive as long as it catches and re-acts at all macroscopic and 
microscopic stimuli. Therefore, this process mandates the setting up of an evaluation and regulation 
mechanism which will continuously and appropriately feed the educational framework, aiming to improve the 
teaching and learning processes. 

Even though the incorporation of Web 2.0 tools in education has been the focus of numerous studies in the 
literature, either focusing on individual components of social networking in educational settings, such as blogs 
and Wikis (Divitini et al., 2005), or operationally partnered with pedagogy and context in a Web 2.0 learning 
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framework (Bower et al., 2009; Wan, 2010; Glud et al. 2010), this evaluation and regulation mechanism is still 
non existing. 

In this work, an integrated self-evaluated and regulated framework, the i-SERF (integrated-Self Evaluated and 
Regulated Framework), is proposed which covers synchronous and asynchronous education, focusing on 
teaching and learning in higher education. The i-SERF framework is a two-layered framework that takes into 
account various elements of existing frameworks, introducing though as a new element the means of a self- 
evaluation, self-feeding and regulation mechanism. This mechanism is based on the performance of students, 
on the students' answers to appropriately structured questionnaires and on the online monitoring of the 
supporting platform's parameters. The proposed framework aims to offer the needed background for 
designing Web 2.0 educational platforms that may exhibit continuous improvement functions, providing in 
that way considerable benefits to both students and tutors in various fields. 

The description of this work begins with an overview of the existing practices for Web 2.0 development in 
higher education. This includes an outline of existing frameworks via which web 2.0 may be deployed and a 
review of evaluation techniques of learning environments. A thorough description of the i-SERF framework on 
a "layer basis" and the way it may be deployed is provided next. An outline of the pilot implementation 
follows, including a brief presentation of the experiment, an outline of the utilized technological infrastructure 
as well as some initial indicative results. The work finishes with conclusions and future steps. 

2. Background Information 

There are many types of Web 2.0 tools while new offerings appear very frequently. The challenge is to use 
these tools as well as other online teaching technologies to enhance learning and teaching, not just because 
they are available. Their effectiveness, though, cannot not be extensively revealed, if they are not deployed in 
a structured and systematic manner. As Harris & Rea (2010), point out what Web 2.0 technologies should be 
deployed in a way that enhances learning and teaching without hindering pedagogy. Regarding the necessity 
of this approach, Cole (2009) provides some important reflections. In particular, she argues that educational 
technology must support student needs by creating a balance between the needs of both lecturers and 
students. She also poses that technology needs to support a pre-existing educational behaviour rather than try 
to import behaviour from other domains. She also points out that educational institutions must be clear about 
the intended outcomes of the technology used, and technological interactivity should not be confused with 
interactive learning. In other words, Cole claims that the on-line learning platform that may host an 
educational activity must be able to efficiently and effectively manage the individual routines of the 
educational process and their interactions. 

Glud et al. (2009) suggest a learning framework which concentrates on the learning control between teacher 
and learner. They identify three factors, namely infrastructure, learning process and resources/content plus 
the factor of motivation, referring to whose initiative a specific course is driven by: the learners' or the 
institutions. Mirsha and Koehler (2006) propose the TPACK (Technological Pedagogical Content Knowledge) 
model, which attempts to capture some of the essential qualities of the teacher knowledge required for 
technology integration in teaching, while it addresses the complex, multifaceted, and situated nature of this 
knowledge. TPACK emphasizes on the importance and the dynamic relationship of the three primary forms of 
knowledge: content, pedagogy, and technology. Wan (2010), based on the analysis of three different models, 
proposed an integrated framework of using Web 2.0 technologies in e-learning 2.0. The framework consists of 
Web 2.0 tools, e-learning 2.0 applications and e-learning 2.0 learning modes (informal and social). Bower et al. 
(2009), propose an approach to conceptualising Web 2.0 enabled learning design based on the TPACK model 
of educational practice. Their proposal includes a framework of typical use cases to illustrate the range of 
learning designs that may be applied for different purposes in order to promote a more expedient application 
of Web 2.0 technologies in teaching and learning. 

3. The proposed framework 

The i-SERF framework that has been utilized to study the incorporation of Web 2.0 tools in higher education is 
shown in figure 1. 
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It consists of two layers: The inner layer (layer-1) is the educational framework that encompasses the dynamic 
relationships and interactions of three primary forms of knowledge: Content, Pedagogy, and Technology. The 
composition of layer-1 takes into account concepts and elements of the frameworks described in section 2. 
The outer level (layer-2) refers to a newly-introduced evaluation and self-feeding mechanism of the "layer-1" 
structure, which is positioned as its macro-environment. The "layer-2" pre-supposes the live capturing of 
appropriately selected parameters from "layer-1" during the educational process. These parameters, which 
are connected to both technological and pedagogical factors, are automatically recorded and evaluated at 
specific time points of the educational process as well as upon the completion of a course. The outcome of the 
analysis of these parameters can be the derivation of new factors connected to various aspects of the 
educational process, the prioritization of the existing factors, or the likely elimination of factors that no longer 
affect the educational process as a consequence of the system's evolution. In this way, the framework as a 
whole is being continuously "self-regulated", while it is used in the educational process. The analytical 
description of the two layers is given next. 
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Figure 1: The i-SERF framework 


3.1 Layer-1 

Layer-1" (inner layer) contains four different components: the technological, the pedagogical, the content and 
the cognitive one, the dynamic relationship and interaction of which take into account the principles of all the 
previously mentioned literature as well as of the aforementioned frameworks. 

3.1.1 Technological perspective of i-SERF 

Web 2.0 applications and services allow the publishing and storing of textual information of audio recordings 
(podcasts), of video material (vidcasts) and of pictures individually by users (blogs) as well as collectively 
(wikis). The challenge for the educational institutions is then to identify what is valuable in using these tools 
and to minimise what is not. According to Boulos (2006), although blog, wiki and podcast technologies in 
higher education have an immense impact, the combined use of them as 'mind tools' (Jonassen, 1999) may 
result in even stronger learning experiences. According to Jonassen et al (1999), 'mindtools' act as cognitive 


www.ejel.org 


321 


©ACPIL 




















Electronic Journal of e-Learning Volume 13 Issue 5 2015 


reflection and amplification tools, aiding the construction of meaning, through the act of the self-design of 
knowledge databases. A generic co-relationship, a dependent positioning, and the potential for confluence of 
the three aforementioned Web 2.0 tools (wikis, blogs and podcasts), within a student centred learning 
environment has also been shown on Boulos et al., (2006). 

The first component of the i-SERF framework, which refers to the technological infrastructure, requires a 
Virtual Learning Environment (VLE) that allows the creation and formulation of a Personal Learning 
Environment (PLE) for the needs of synchronous and asynchronous learning. This component is based on the 
principles of social networking (Europe's Information Society, 2009). Therefore, it should include all the 
aforementioned Web 2.0 tools in order to facilitate both the "horizontal" (among peers) and the "vertical" 
(educators with students and vice versa) communication and to support both static and social course content. 

A Blog in i-SERF should be dedicated to a particular course, in order to facilitate the creation of an educator's 
"e-office", providing announcements, annotated links for readings or references, posting of course material 
and time schedules, networking and personal knowledge sharing. With blogging educators can keep the 
students engaged by promoting their active participation (Ajjan & Flartshorne, 2008). Educators can also have 
an indication of the students 1 motivation, misconceptions, struggles, discomforts and learning experiences and 
they may proceed to necessary accommodations in the instructional activities (Yang, 2009). In this way, they 
can increase the students' learning efficiency and satisfaction. Teachers are, thus, provided with the choice to 
transfer the "control of the learning experience" over to the students' side and to re-adjust motivation, an 
issue that has been raised by Glud's et al framework. Of course, the final decision about the balancing control 
with the educational environment depends mainly on the pedagogical view of the activity as well as on the 
nature of the subject matter that is being processed. 

Wikis have their place in i-SERF as they provide an editable website that is created incrementally by visitors. 
Wikis can be used to facilitate computer-supported collaborative learning (Augar et al., 2004), to enhance peer 
interaction and group work, and to facilitate the sharing and distribution of knowledge and expertise among a 
community of learners (Lipponen, 2002). Wikis enhance asynchronous communication and cooperative 
learning among students and promote cooperation rather than competition (De Pedro et al., 2006). Using a 
wiki as a writing tool maximizes the advantages of reflection, reviewing, publication, and of observing 
cumulative written results as they unfold (Fountain, 2005). Duffy and Burns (2004) list several possible 
educational uses of wikis, with group authoring being the most common pedagogical application. Cole (2009), 
at a failed action research experiment to integrate a wiki into an existing teaching format, reveals that the 
reasons of failure ranged from academic pressure from other courses (educational constraint) to ease of use 
concerns (technical constraint) to issues of self-confidence (personal constraint) and, finally, to a total lack of 
interest. Hence, with a savvy learning design, the benefits of social interaction and active participation 
experienced by collaborating online may not be diminished by any of the encountered drawbacks. 

Podcasting technology, allows the easy broadcasting of audio and audio-visual files. It is expected that 
podcasting within i-SERF will enable the dissemination of learner-generated content to participants, which, in 
turn, will act as a catalyst and support for learning. The most popular use of podcasts in education is the 
provision of introductory or preparatory material before lectures, or, more commonly, the recording of 
lectures and their reproduction in order to be accessed by students because they were unable to attend the 
lectures physically, or to reinforce their learning. Therefore, the quality of the audio-visual files that contain 
the live classroom material, in terms of content and presentation, determines the extent to which a podcast 
affects a lecture's efficiency by reproducing it. Similarly, the "easiness" of access to a repository of podcasts 
also influences the students' engagement to actively participate in a course, since podcasts require high speed 
Internet access for streaming or downloading. Fernandez et al.'s (2009) research work revealed that 
podcasting is a powerful tool as a complement to traditional course resources, but not regardless of them. 

Microblogging is one of the latest Web 2.0 technologies. The key elements of microblogging are online 
communication using 140 characters and the fact that it involves "following" someone. Microblogs cover the 
gap between blog and direct messaging. Popular microblogging platforms used in education include Twitter, 
Cirip, Edmodo and Plurk. As the technology of microblogging is adopted in a variety of contexts, its usefulness 
becomes increasingly compelling for educational actors. A list of basic functions that microblogging can 
provide are: outasking questions, giving opinions, changing ideas, sharing resources and reflection (Ebner et 
al., 2010). 
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Social bookmarking is the practice of saving bookmarks to a public Web site and "tagging" them with 
keywords. In education teachers and students can create lists of 'bookmarks' or 'favourites' (for instance 
reading lists or collections of resources) and they can store them centrally on a remote service, so that they 
are able to share them in a local or a wider educational community. 

In all cases, RSS (Really Simple Syndication) feeds benefit educators by letting them syndicate content 
automatically. 

Finally, the technological infrastructure should be capable of facilitating online lectures and supporting a live 
class. During the online lectures, the educators should have at their disposal a variety of synchronous 
technologies, including a slide presentation view with cursor, raise hand, public and private chat, audio and 
video conferencing, desktop sharing and shared whiteboard. 

3.1.2 Pedagogical perspective 

The second component deals with the pedagogical perspective of the framework. This component includes 
potential pedagogies, learning approaches and best practices in teaching and learning the deployment of 
which may enhance teaching and learning. Within the life cycle of a course, the nature of the activities may 
vary (for instance they may include theory or laboratory), which in turn influences the nature of the pedagogy 
to be applied from the teachers' point of view and the learning practices from the students point of view. Since 
i-SERF deals with online activities supported by the Web 2.0 technological infrastructure, the aim of this part of 
the framework is to define pedagogies and learning practices, which in their interaction with technology and 
context may yield better teaching and learning experiences. 

There are various pedagogical theories and models that underpin the theoretical background of the use of 
Web 2.0 in education, some of which have been investigated even before the predominance of ICT. The most 
recent theories, the use of which may enhance the teaching and learning process on a Web 2.0 platform, are 
the theory of learning communities, the theory of Bandura (Social Learning Theory), the communities of 
practice and the virtual communities (Wenger & Snyder, 2000; Andreatos, 2008). In 2005, Siemens formulated 
a relatively new theory, called Connectivism (Siemens, 2005). Connectivism is a relatively new learning theory 
combining relevant elements of many learning theories, social structures and technology to create a powerful 
theoretical construct for learning in the digital age, including the fact that the acquired knowledge is constantly 
decreasing. The latter makes informal learning through personal social networks, communities of practice and 
the like very important in the workplace (Andreatos, 2007). 

Constructionism, advocated by Seymour Papert, is particularly amenable to Web 2.0 approaches. 
Constructionist learning is inspired by the constructivist theory that individual learners construct mental 
models to understand the world around them. Flowever, constructionism argues that learning can happen 
most effectively when students are also active in making tangible objects in the real world. Clements (2009), as 
cited by Bower (2009), describes virtual constructionism as "understanding the relationship between teaching 
and student learning, and integrating it effectively with e-learning technologies to support students in 
constructing meaningful experiences". Therefore, prior to practicing constructionist approaches in a Web 2.0 
environment an understanding of the Web 2.0 tools that best apply to the accomplishment of a particular task 
is presupposed. 

Behaviourism in a Web 2.0 environment has an important role, since the environment itself provides stimuli 
that cause the occurrence of behavioural consequences, observed over a Web 2.0 platform, not only for the 
user himself but also for the rest of the participants in the "mini" internet-community of a university course. 
These consequences may have an effect on the learning process. Thus, teachers attending to the changes in 
the behaviour of users are in the position to directly diagnose their learning needs, encourage them, support 
them and guide them online. i-SERF introduces a self-evaluation mechanism (the detailed description of which 
is included in the "layer-2" description) which is based on the performance of students, on the students' 
answers to appropriately structured questionnaires and on the on-line monitoring of the supporting platform's 
parameters. Therefore, the pedagogical implications of the behavioral learning processes are considered 
mandatory in the layer-1 learning process component. 
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Finally, a transmissive learning process, is included in the learning component of layer-1, whereas a stream of 
information is broadcast to students (Bower, 2009), either within the "online" class (synchronous) or via 
podcast technology (asynchronous). 

Beyond the purely pedagogical approach, the optimal adoption of Web 2.0 should take into account existing 
best practices to achieve the full-scale deployment of any proposed framework and to minimize the possibility 
of misleading conclusions. The literature is rich with "best practices" aiming to improve the students' learning 
processes in higher education. Within the scope of i-SERF, these practices may act complementarily to the 
aforementioned "established" learning theories while providing practical tips at instances that are not 
sufficiently covered by these theories. One widely accepted practice is the one of Angelo (1993), who suggests 
that students learn best when they receive feedback quickly and at regular intervals, that information that is 
organized in a personal way is more likely to be understood, preserved and recalled whenever necessary and 
that the assessment and evaluation method of the students' performance strongly affects their study and 
learning process. 

3.1.3 Knowledge and Cognitive Process Dimension 

The third and fourth components correspond respectively to the knowledge dimension and the cognitive 
process dimension of the Anderson and Krathwohl Taxonomy of Learning, Teaching and Assessing (Anderson & 
Krathwohl, 2001), as elaborated by Bower et al. (2009) in their framework. 

Following one of the biggest key ideas of Tim O' Reilly, that of the "Individual Production and User Generated 
Content" (Anderson, 2007), Web 2.0 tools have lowered the entry barriers concerning the creation of 
information. Towards this goal, individuals are setting up their personal blogs, they post to blogs other than 
theirs, they participate in forums and they work collaboratively to create information via wikis. Content can be 
created from scratch or existing content may be edited and altered in several ways. Content can be used 
purely as data, as part of a process, or as an enabler of social software and social interaction (Franklin & Van 
Harmelen, 2007). From an educational point of view, the content is the specific knowledge that the learning 
design should address. Anderson and Krathwohl incorporate a knowledge dimension and a cognitive process 
dimension in a learning framework. Then they distinguishes knowledge according to the kind of the orientation 
of matter content as: Factual, Conceptual, Procedural and Metacognitive. The level of this cognitive process 
dimension includes: Remembering, Understanding, Applying, Analysing, Evaluating and Creating. These levels 
represent a continuum from lower order thinking skills to higher order thinking skills, with lower level thinking 
capacities being a necessary prerequisite for the corresponding higher order thinking skills to occur (Bower, 
2009). 

3.2 Layer-2 

"Layer 2" (outer layer), incorporates the evaluation and the analysis of the "layer-1" structure. 

3.2.1 Description of the Evaluation Strategy 

As a base for establishing the evaluation procedure, the statistical process control (SPC) toolbox is used. This 
set of techniques has been extensively used for monitoring and controlling industrial processes. The 
monitoring and controlling of the process ensures that it operates at its full potential. At its full potential, the 
process can make as much as possible "conforming products" (output meeting specifications) with a minimum 
of "non-conforming products". Today, the use of SPC techniques has been also extended in non-industrial 
processes, since SPC can be applied to any process where output can be measured. Control charts are the key 
tools used in SPC, as they assist in the early detection and prevention of problems, rather than in the 
correction of problems after they have occurred. The evaluation strategy is described in the following 
paragraphs. 

A. Evaluation System Characteristics 

"Layer-2" presupposes the live capturing of appropriately selected parameters connected to both 
technological and pedagogical factors. These parameters are automatically recorded and evaluated at specific 
time points of the educational process as well as upon the completion of a course. The recorded parameters 
used for evaluation are divided into the following sub-sets: 
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■ Sub-set 1 includes parameters of the Web 2.0 platform related to the frequency, the duration and the 
type of its use by the students. 

■ Sub-set 2 includes parameters related to the performance of the students. The acquisition of this data is 
done using appropriate online tests (e-tests), connected to the course material at specific time-points. 

■ Sub-set 3 includes parameters related to the satisfaction of the students. The acquisition of this data is 
achieved using appropriate electronic questionnaires 

Thus, the frequent capturing of data in various forms allows tutors to assess the students' "behaviour", 
"performance" and "satisfaction" within the course lifetime and to consider the possibility of proceeding in 
correcting actions, not only at the end of the course based on cumulative results but also in between, 
whenever that is considered necessary. 

Of course, it is not always possible for the tutor to manage this vast amount of data. Thus, in order to achieve 
the self-evaluation of the system, the recorded parameters are appropriately analysed using advanced 
statistical analysis techniques and state-of-the art statistical process control (SPC) techniques (Balakrishnan et 
a I, 2009). SPC techniques have been embedded in the field of education after being properly adjusted, in order 
to monitor and control the individual performance of students, the satisfaction of the students from the 
platform and the use of the system by the students. 

The specific SPC toolbox that is used for achieving the total monitoring of the educational procedure is the 
multivariate SPC toolbox (Bersimis et al. 2007; Koutras et al., 2006), and, in particular, the methodologies 
based on dimension reduction techniques. Multivariate SPC takes into account, apart from the marginal 
variability of each characteristic, the complex structure formed by the interactions between the monitored 
parameters. 

The use of the SPC toolbox was born by the fact that every student has its own nominal level regarding a 
subject, a level that is related to this specific subject as well as to the result of a long-term educational process. 
Moreover, the need of MSPC (Multivariate SPC) techniques is born by the fact that the class performance 
affects the individuals' performance while the individuals' performance affects class performance. Thus, using 
MSPC we may monitor simultaneously class as well as individuals' performance. 

B. Phases of the Evaluation 

As in standard SPC practice, two distinct phases are used: Phase I and Phase II. In Phase I, the basic aim is to 
test historical data for identifying whether they were sampled from an in-control process and to define the in¬ 
control state. In Phase II, the basic aim is to test future data for specifying whether the process remains in¬ 
control or has shifted to the out-of-control state. Specifically, every new observation or subgroup is tested and 
using of specific rules it is decided whether the state of the process has changed or not. 

C. Phase I: Initialization of the Evaluation System 

An initiation (Phase I) is required in order for the system to reach a nominal level (to define the in-control 
state). This initiation may be achieved via a pilot implementation, in order to define an "in-control state". The 
pilot phase takes the place of Phase I analysis used in the SPC literature. The period of the pilot phase may be 
defined either as the first weeks of a specific class or as the usual results of the class in the previous years. In 
practice, all the parameters that are recorded during the pilot implementation are appropriately analysed and 
the "in-control state" is estimated. The initialization of the evaluation system is done at both the student and 
the class levels. 

Specifically, in the initialization phase the tutor gives to the students the regular tasks. The platform records 
the necessary data (frequency, duration and type of platform use, performance through short tests and 
satisfaction through questionnaires). Finally, the mean level for each student for all the parameters as well as 
the structure of the relations among the parameters are estimated. The mean level is represented by the 
mean vector 


X = [*l *2 - X p \ xp 


and the structure of the relations among the parameters is represented by the variance-covariance vector. 
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Each of the variables X lt X 2 , ..., X p represents one of the parameters recorded and analysed on line. The 
quantities S U/ S 12 ,..., 5 PP represent the covariance among two variables, that is the effect of one variable on the 
other (e.g. the effect of the frequency of the use of the platform on the performance of the individual 
student). 

D. Phase II: Use of the Evaluation System during the Educational Process Evolvement 

In each future time point, the values of the captured parameters for each student are continuously modelled 
and compared to the nominal levels estimated during Phase I. Moreover, the platform's data as well as the 
questionnaires' data are combined with the data provided by the e-tests realizing a system that may capture 
the relation between the effort and the performance of the student. Then, appropriate control charts are used 
in order to identify possible unusual conditions as well as to interpret them (Maravelakis et al., 2002), in terms 
of finding the root of these unusual conditions. The identification of a problem and its interpretation are 
possible because each set of parameters reflects a different aspect of the learning attitude of an individual. 
Thus, if a control chart related to one student signals, then we may identify a student having a problem. 
Finally, if the number of students that present an abnormal behaviour is high, evidently the system needs to be 
improved (class performs abnormal). Thus, the framework as a whole is being continuously "self-regulated". 
Another improvement to the abovementioned procedure, could be the use of one sided control charts, since 
we are interested only in cases that either a student or the class getting worst. 

E. Dashboard of the Evaluation System 

A (n x p) dashboard is used for the dynamic handling of all the aforementioned parameters (Figure 2). In the 
horizontal dimension (n-dimension) of the dashboard the names of the students are found, while in the 
vertical dimension (p-dimension) the corresponding parameters. 
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Figure 2: Students Control Panel over Dashboard 
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3.2.2 Parameters of the System 

As already mentioned the parameters used for evaluation are of three broad categories. The first category 
includes the extended set of parameters of the Web 2.0 platform used. The system monitors on a daily basis 
the following parameters: number of visits, time spent in the platform, average time during these visits, 
cumulative time over the platform, maximum time at one visit over the platform, time spent using each 
component (podcasts, forums, etc.) of the platform, etc. In this category we include parameters related to the 
class itself (for example the number of absences in a particular course). Then the data are aggregated on a 
weekly basis in order to be aligned with the lectures' schedule. All these parameters are represented as a p r 
dimensional random vector U t ,„ i=l,2,...,s, where s is the number of students in a class and t represents time 
(we may assume that the first time points can be used in order to estimate the nominal level of each student). 

The second category includes the periodic capturing of the performance of the students using appropriate fast 
e-tests (on a weekly basis) and tasks. Each week, an e-test is used in order to evaluate the effort that is put by 
each student. Additionally, the performance is evaluated by taking into account the grades per assignment. 
The performance of each student is represented as a p 2 -dimensional random vector Y t/ , /=l,2,...,s, f=l,2,... 

The third category includes the periodic capturing of the satisfaction of the students using the pre¬ 
programmed sampling of the electronic questionnaires. The students, on a monthly basis (the results are then 
conversed to a weekly basis), answer a structured questionnaire related to the satisfaction of the students 
from the platform as well as from the class itself. 

Here we have to note that in order to reclaim the questionnaire data in the initialization phase an extended 
use of the multivariate analysis technique Factor Analysis is performed. 

Specifically, in Phase I a historical data set is analysed and the most significant factors are accrued. Each factor 
is strongly related to a different aspect of the learning attitude of an individual. Since each factor is 
independent from the others, we may monitor and control more than one parameter in a single control chart 
for each individual, while additionally we may control the overall learning procedure. The satisfaction of each 
student is represented as a p 3 -dimensional random vector F t ,, /=l,2,...,s, t=l,2,... 

By joining the random vectors U, Y, F, we create the random vector X t , having p dimensions that represents all 
the parameters. In Phase I we estimate the mean of X, say n, which acts as the nominal level of each student. 

3.2.3 Monitoring 

In Phase II, monitoring is performed using the Shewhart-type chi-square multivariate control chart (CSCC), in 
which, for each time point t, a statistic of the form is calculated, 

(X t -X) 7 S _1 (X f -X), t = 1,2,..., (1) 

where X is the sample mean vector, S is the sample covariance matrix and X t is the respective multivariate 
observation at time t for a certain student. Then, this statistic is plotted in a control chart with suitable control 
limits calculated from an appropriate F distribution. In case that for a certain time t we do not have the 
complete information we replace the missing value with the historical mean. 

In figure 3 we present the control chart for a sample class for the duration of a year. In the x-axis we represent 
the time (e.g. the lecture number) while in the y-axis the values from equation (1). As we can see at the last 
time points we have large values of (X t -X) T S" 1 (X t -X), t = 1,2,... which means that there exist large 
differences from the nominal. The next step is to diagnose if these differences are due to improvement or due 
to deterioration. As already mentioned we could use an appropriate one sided control chart, since we are 
interested only in cases that either a student or the class getting worst. However, this is an open problem in 
the MSPC field. 
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Figure 3: The Chi-square multivariate control chart (CSCC) 

4. Pilot Implementation 

In order to assess the effectiveness of i-SERF, a pilot implementation has been carried out within a course 
lifetime in the Department of Informatics of a Greek university. At this aspect the pilot implementation aimed 
to investigate the lead factors, derived from selected parameters connected to the students' behaviour, 
perceptions and satisfaction that may be taken into consideration in the incorporation of a Web 2.0 learning 
environment in the educational process driven by the i-SERF framework. Moreover, the investigation included 
the study of the correlations of these factors and their effect on the students' performance. Finally, we studied 
how the students' activities on the online environment affected their performance. The full description of the 
pilot implementation has been presented in (Karvounidis et. al, 2014) and in (Karvounidis et. al, 2015), 
respectively. 

The target group was IT students, who were considered to be academically more competent to new 
technologies compared to other target groups, and, hence, having higher expectations, since they do not judge 
only as users, but also as potential creators or enhancers of these technologies. The implementation plan 
included the splitting of the "audience" into two groups. Lectures were given once for both groups: The first 
group (Group A) was attending lectures in the classroom and used all the available at the university 
conventional and commonly-used infrastructures for communicating and providing information and material 
for the successful completion of the course. The second group (Group B) was attending lectures "web-based" 
via the electronic medium at the same time from a terminal device of their choice and using exclusively Web 
2.0 tools to successfully fulfill the course requirements. The basic rule was that the two groups do not meet 
and work with each other within the framework of the particular course. All the participation rules were 
clearly stated during a presentation at the very beginning of the course. In order to reduce the possibility of 
"contamination" of the outcome of the experiment, the participation in the experiment was voluntary and the 
students consented that "rules" will not be violated. 

For the evaluation of the results of the experiment, descriptive and inferential statistics methods (Johnson et 
al., 2007) in combination with the multivariate analysis technique "factor analysis" (Bartholomew et al., 2008) 
were used. The extraction method used was FA (using Principal Components Analysis method). The design of 
the questionnaires took into account findings and key points from the literature discussed in the background 
information. The questionnaires have also been based on existing best practices in accessing information and 
communication technologies in a university learning environment (such as Breen's et al. (2001)). The 
Cronbach's alpha coefficient of reliability was used in order to measure the internal consistency of each used 
questionnaire. 

The pilot implementation revealed that although the deployment of the i-SERF framework did not directly 
affect the students' performance, it is a tool acceptable by both students and faculty. The assessment on 
students' perceptions on various aspects related to course deployment indicated viable satisfaction on the 
deployed process and, consequently, of the particular framework that the course was performed. Empirically, 
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instructors have expressed their conformity on deploying the i-SERF on the course within a Web 2.0 
environment. 

The study has also emerged significant correlations and interdependencies between the students' activities 
over the used electronic medium (platform) and their performance in various time-points within the course 
time line. More specifically, the performance has been found to be directly affected by the frequency of the 
interactions with the electronic medium (platform) at which the educational process has been carried out and 
indirectly by a variety of factors that aim to enhance their learning interest and experience. In conclusion, the 
outcome from the pilot implementation showed the Web 2.0 infrastructure is a tool that facilitates on-line 
learning service delivery, driven of course by a proper framework that leverages the social interaction and 
active participation within the educational process. 

As major limitation of the pilot implementation is considered the fact that the selected group was competent 
on IT - as expected from students of an Informatics Department. This may resulted on the one hand in 
valuable remarks regarding technical aspects, on the other hand though, it narrowed the view of the extent of 
comfortless of a less IT- literate student. Ullrich et al. (2010) when applying Web 2.0 tools in language learning 
subject - with less IT-literate students than ours - observed that students were not "ready" to use them. In 
order to have a more complete view of the effectiveness of i-SERF in a Web 2.0 based learning environment, 
the overall is currently being held with a different student body over a Statistics Department course. 

5. Conclusions 

In this work, an integrated framework that covers synchronous and asynchronous education in a Web 2.0 
learning environment has been proposed. Existing works, principles, views and strategies have been taken into 
consideration in the development of this framework. The proposed framework embeds self-evaluation and 
regulation mechanisms that are based on the performance of students as well as on answers to appropriately 
structured questionnaires and on on-line monitoring of the supporting platform's parameters. 

This research can also be used as the baseline for improving the higher educational process at various levels. It 
is very important to fully explore the deployment of the proposed framework, and to minimize the possibility 
of misleading conclusions. Using advanced technologies for online testing in a Web 2.0 environment and by 
combining knowledge and cognitive dimensions, the proposed framework could also provide, among other 
benefits, important information (metrics) for the adjustment of the examination tools used in the educational 
process. Finally che mechanism itself can also been improved in future a research with the implementation a 
self-adaptive process monitoring system. 
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